(19) 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(11) EP 0 487 110 B1 

EUROPEAN PATENT SPECIFICATION 



(45) Date of publication and mention 
of the grant of the patent: 
06.10.1999 Bulletin 1999/40 

(21) Application number: 91119983.4 

(22) Date of filing: 22.11.1991 



(51) lntCL6: G06F 19/00 



(54) Computer-aided diagnosis system for medical use 

Rechnergestutztes System zur Diagnose fur medizinischen Gebrauch 
Systeme assists par ordinateur pour le diagnostic a usage medical 



(84) Designated Contracting States: 
DENL 

(30) Priority: 22.11.1990 JP 32049890 

(43) Date of publication of application: 
27.05.1992 Bulletin 1992/22 

(73) Proprietor: KABUSHIKI KAISHA TOSHIBA 
Kawasaki-shi, Kanagawa-ken 210-8572 (JP) 

(72) Inventors: 

• Yamada, Shinichi, c/o Intellectual Property Div. 
Minato-ku, Tokyo 105 (JP) 

• Komatsu, Kenichi, c/o Intellectual Property Div. 
Minato-ku, Tokyo 105 (JP) 

• Ema, Takehiro, c/o Intellectual Property Div. 
Minato-ku, Tokyo 105 (JP) 

(74) Representative: 

Blumbach, Kramer & Partner GbR 
Radeckestrasse 43 
81245 Munchen (DE) 



ID 
O 



00 

o 

Q. 

LU 



(56) References cited: 
EP-A- 0 366 076 
DE-A- 3 823 251 



EP-A- 0 380 966 
US-A- 5 021 770 



• PROCEEDINGS OF THE 12TH ANNUAL 
INTERNATIONAL CONFERENCE OF THE IEEE 
ENGINEERING IN MEDICINE AND BIOLOGY 
SOCIETY, IEEE PRESS NEW YORK US vol. 1/5, 
1 November 1990, PHILADELPHIA, US pages 21 9 
- 220 , XP000239502 YONGMIN KIM ET AL 'A 
NEXT BASED HIGH PERFORMANCE IMAGE 
COMPUTING WORKSTATION FOR BIOMEDICAL 
APPLICATIONS' 

• PROCEEDINGS OF IMAC 89, IEEE COMPUTER 
SOCIETY PRESS NEW YORK US 4 June 1989, 
WASHINGTON D.C., US pages 104 - 107 , 
XP000201387 J.H.PERRY TACS 
WORKSTATIONS' 



Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give 
notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in 
a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 
99(1) European Patent Convention). 



Printed by JoLive. 75001 PARIS (FR) 



1 

Description 

[0001] The present invention relates to a computer- 
aided diagnosis systenri for medical use, which outputs 
computer-aided diagnosis data for medical images us- 
ing a computer. 

[0002] Recently, a computer-aided diagnosis system 
(hereinafter referred to as a CAD system) for medical 
use has been developed in which the features of medi- 
cal image data are determined and computer-aided di- 
agnosis data (hereinafter referred to as CAD data) for 
assisting a doctor are obtained by using a computer. It 
is, however, cumbersome for a doctor to operate a com- 
puter to obtain the CAD data during the diagnosis, re- 
sulting in an adverse effect on a reading operation of 
image in terms of both time and labor. Further, the con- 
ventional CAD system itself cannot provide a high pre- 
cision CAD data required for the diagnosis. 
[0003] Examples of such CAD system are disclosed 
in US-A-4,B51 ,984 and US-A-4.B39,807. The CAD sys- 
tem described in the above US-Patents comprises 
means for inputting a medical image, means for analyz- 
ing the medical image using a predetermined CAD al- 
gorithm, and means for displaying an analysis result. 
[0004] The doctor refers to the output of the CAD sys- 
tem at the time of reading of the medical image to pre- 
vent an oversight of a shadow image of the abnormal 
portion. 

[0005] To obtain the CAD data, the following proceed- 
ings are required. Locations of one type of abnormal 
shadow images, e.g. , an abnormal shadow image of the 
interstitial lung disease, are detected on a conventional 
X-ray radiograph and the result of the detection is out- 
put. Therefore, the medical image on the X-ray film is 
digitized. A rib, an object of the analysis, is identified in 
the medical image. A region of interest (hereinafter re- 
ferred to as a ROI) is set on the medical image, as de- 
scribed in the US-A-4,851 ,984. The data in the ROI is 
frequency-analyzed to extract the amount of physical 
texture of the image. The shadow image is classified into 
groups based on the amount of physical texture. A dis- 
play device displays the digital image and the type, de- 
gree, and position of the shadow image in an overlap- 
ping manner. 

[0006] The reading operation by the doctor is to draft 
the reading report. Before drafting the report, the doctor 
refers to the CAD data to prevent an oversight of a shad- 
ow image. 

■ [0007] If the doctor needs the CAD data, the above 
proceedings must be performed. That is, the medical im- 
age must be digitized before the CAD system starts to 
operate. The digitized image is analyzed by the compu- 
ter using the above proceedings and the analysis result 
is output to an attached display device. The doctor con- 
tinues the reading of the image after watching the CAD 
result. 

[0008] The above described CAD system has follow- 
ing drawbacks. 
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[0009] The same CAD algorithm which is included in 
the CAD system is applied to the image data regardless 
of the type of the image. For example, the same CAD 
algorithm is applied to a conventional X-ray radiograph 
5 of chest as well as a CT image. Therefore, an unexpect- 
ed CAD result is obtained thus lowering the ability of di- 
agnosis. 

[001 0] The CAD system includes only one CAD algo- 
rithm for a given disease. Therefore, it is not possible to 

10 obtain a plurality of CAD data for a plurality of diseases. 
Therefore, if ten diseases are to be detected from one 
image based on the CAD data, the image data must be 
input to ten CAD systems and ten CAD data must be 
output. This increases the time and labor for the CAD 

15 operation. 

[0011] A time for merely reading the image without 
outputting the CAD data is about three minutes. A time 
from requesting a kind of CAD operation to output the 
CAD data is about two minutes. If the CAD operation is 

20 performed during the reading, it takes a long time for 
reading and a difficulty occurs for the reading. 
[0012] The CAD data includes many items, e.g., the 
position, type, and degree of the abnormality. In the con- 
ventional CAD system, all the items of data are output, 

25 thereby the output becomes complicate. 

[0013] The CAD system does not store the CAD re- 
sult, therefore, if the CAD operation is requested for the 
image which has been once analyzed, the same CAD 
operation is repeated thus wasting the time. 

30 [0014] Meanwhile, a picture archiving communication 
system (hereinafter referred to as a PACS) for transfer- 
ring, storing, and displaying the medical images has 
been developed. In the PACS, digital medica! image da- 
ta archived by modalities including a digitizer and at- 

35 tribute data thereof are transferred via a network and 
are stored in a targe capacity recording means such as 
an optical disk device. Desired data are retrieved by us- 
ing a data base system. The image data is transferred 
to a workstation via the network and is displayed. How- 

40 ever, the prior PACS does not perform a CAD operation. 
[0015] EP-A-0 366 076 discloses a PACS system 
wherein image data and image addition data are stored 
in a data base. The PACS comprises medical diagnosis 
apparatuses which are coupled to work stations via in- 

45 terface units and a star coupler. The system generates 
an unread examination list and a read examination list 
which are transferred to the work stations at the time of 
a reading operation wherein the list data of the read ex- 
amination list is arranged in accordance with a desired 

50 priority order. 

[0016] Shimadzu Review, Japan, July 1990, Vol. 47, 
No. 2, pages 1 63 to 1 68; M. Andoh et al: "Shimadzu Al- 
PACS SAIPACS" discloses a PACS system wherein the 
work stations are arranged to perform a computer-aided 

■55 diagnosis and a computer-aided diagnostic reporting, 
by using artificial intelligence technique. 
[0017] It is an object of the present invention to pro- 
vide a system for analyzing a medical image using a 



EP 0 487 110 B1 



2 



3 



EP 0 487 110 B1 



4 



computer-aided diagnosis algorithm, for medical use, 
wiiich outputs computer-aided diagnosis data with high 
precision by a simple operation having no adverse effect 
on diagnosis made by doctors. 

[0018] This object is achieved by the features men- 5 
tioned in independent claim 1 . 
[0019] Some preferred implementations are defined 
in the subclaims. 

[0020] The present invention thus also provides a pic- 
ture archiving communication system incorporating the io 
computer-aided diagnosis system for medical use and 
having a high diagnosis precision. 
[0021] This invention can be more fully understood 
from the following detailed description when taken in 
conjunction with the accompanying drawings, in which; ^5 

Fig. 1 is a block diagram showing the arrangement 
of a first embodiment of a computer-aided diagnosis 
system for medical use according to the present in- 
vention; 

Fig. 2 shows items of examination data; 
Fig. 3 shows a practical example of the examination 
data for a conventional X-ray radiograph of chest; 
Fig. 4 is a block diagram showing the arrangement 
of a film digitizer shown in Fig. 1 ; ^5 
Fig. 5 shows items of relevant data; 
Fig. 6 shows a practical example of the relevant da- 
ta; 

Fig. 7 is a view for defining an imaging direction in 

the conventional X-ray radiography; 30 

Fig. 8 is a block diagram showing the arrangement 

of a data base shown in Fig. 1 ; 

Fig. 9 shows an examination directory included in a 

data retrieving device shown in Fig. 8; 

Fig. 10 shows the relationship between a doctor ID 55 

and a requesting doctor ID which is used when the 

image is transferred to a workstation at the time of 

reading; 

Fig. 11 shows an operation for transferring the im- 
ages which has been examined to the workstation 40 
at the time of reading; 

Fig. 1 2 is a block diagram showing the arrangement 

of the workstation shown in Fig. 1 ; 

Fig. 13 shows an example of the images displayed 

on the workstation in the PACS at the time of diag- ^5 

nosis of the conventional X-ray radiograph; 

Fig. 1 4 shows a CRT image display control table for 

managing the display of the workstation; 

Fig. 15 shows a table registering the relationship 

between the name of a CAD algorithm and associ- 50 

ated attribute data of the image which is applied with 

the CAD algorithm; 

Fig. 1 6 is a view showing a practical example of ROI 
setting in lungs; 

Fig. 17 is a block diagram schematically showing 55 
an algorithm for automatically setting an ROI; 
Fig. 1 8 is a detailed block diagram for explaining the 
diagram of Fig. 16; 



Fig. 19 is a block diagram schematically showing 
an algorithm for obtaining the amount of textures in 
the ROI; 

Fig. 20 is a flow chart schematically showing an al- 
gorithm for determining based on the amount of tex- 
tures whether the ROI is normal or abnormal; 
Fig. 21 is a block diagram performing the operation 
shown in Fig. 20; 

Fig. 22 shows an example of the data format of a 
CAD result; 

Fig. 23 is a view showing a practical example of the 
CAD result data; 

Fig. 24 is a perspective view showing a touch panel 
as an example of an input device of the workstation; 
Fig. 25 is a view showing a display example of the 
touch panel; 

Fig. 26 is a view for explaining an example of a 
schematic naming of abnormal positions; 
Fig. 27 shows a relationship between locations and 
coordinates of the abnormal positions; 
Fig. 28 shows a table for explaining an example of 
detailed naming of the abnormal positions; 
Fig. 29 shows an example of a text sentence dis- 
play; 

Fig. 30 shows an example of marker display; 
Fig. 31 shows an example of detailed CAD display 
using the marker shown in Fig. 30; 
Fig. 32 shows another example of the marker dis- 
play; 

Fig. 33 shows an ROC curve display as an optional 
CAD output; 

Fig. 34 shows the data format of a CAD result; 
Fig. 35 shows a practical example of the CAD result; 
Fig. 36 is a block diagram showing the arrangement 
of a CAD processor included in a second embodi- 
ment of a computer-aided diagnosis system for 
medical use according to the present invention; 
Fig. 37 is a block diagram showing the arrangement 
of a sound output device as a main part of a third 
embodiment of the present invention; 
Figs. 38A and 38B show examples of a menu win- 
dow display according to a seventh embodiment of 
the present invention; 

Fig. 39 is a block diagram showing the arrangement 
of a computer-aided diagnosis system according to 
an eleventh embodiment of the present invention; 
Figs. 40A to 40E show modifications of marker dis- 
play according to a twelfth embodiment; 
Figs. 41 A to 41 F show other modifications of the 
marker display according to the twelfth embodi- 
ment; 

Figs. 42A and 42B show still another modifications 
of the marker display according to the twelfth em- 
bodiment; and 

Fig. 43 shows an example of a table formed of 
names of algorithms stored in a memory in a sev- 
enteenth embodiment of the present invention. 
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[0022] A preferred embodiment of a computer-aided 
diagnosis system for medical use according to the 
present invention will now be described with reference 
to the accompanying drawings. Though it is possible to 
embody the CAD system as a stand-atone system, an 
embodiment of the CAD system incorporated into the 
PACS will be described. Fig. 1 is a block diagram show- 
ing the first embodiment constructed on the basis of the 
PACS. In general, the PACS is a system for performing 
storage and transferring of various types of digital image 
data produced in a single or a plurality of hospitals, and 
is formed of an image data source 10 (hereinafter re- 
ferred to as a modality), a data base 12, a workstation 
14 as a display unit, and a network 16 for connecting 
these components. 

[0023] The modality 1 0 includes various diagnosis de- 
vices for generating medical digital images, such as a 
film digitizer 18 for digitizing an image of an X-ray film 
obtained by an X-ray radiography apparatus, an angi- 
ography imaging apparatus 20, a computed tomogra- 
phy (CT) scanner 22, a magnetic resonance imaging 
(MRI) system 24, a nuclear medicine diagnosis appara- 
tus 26, an ultrasound diagnosis apparatus 28, and an 
electric endoscope 30. 

[0024] An examination ordering system 32 is also 
connected to the network 1 6 via a gateway 34. The ex- 
amination ordering system 32 supplies examination da- 
ta indicating details of examination on individual patients 
to the network 16. In this manner, the PACS performs 
control of data on the basis of correspondence between 
image data obtained by examination by the modality 10 
and attribute data (including examination data, relevant 
data, and amend and/or update data for these data sup- 
plied from the workstation 14 and the data base 12). It 
is noted that the number of each of the modalities 10, 
the data base 2. and the workstation 14 is not limited to 
that of the above arrangement but can be increased or 
decreased as needed. 

[0025] Fig. 2 shows an example of items of examina- 
tion data input by the examination ordering system 32 
and supplied to the network 16. An examination ID 
number is issued every time examination is performed. 
In the examination ordering system 32, such examina- 
tion data is input by a doctor or a person in charge at 
the start of examination, and a technician of the modality 
executes examination on a patient upon receiving the 
examination request, thus obtaining image data. Each 
frame of the image data is associated with the relevant 
■data. An example of the relevant data is shown in Fig. 5. 
[0026] When, for example, radiographic examination 
using a conventional X-ray radiography apparatus is 
necessary, examination data as shown in Fig. 3 is input 
from the examination ordering system 32. A radiograph- 
ic technician of the conventional X-ray radiography ap- 
paratus (not shown) takes conventional X-ray radio- 
graphs according to the input examination data. In the 
case of a conventional X-ray radiograph, digital image 
data can be obtained by digitizing the image of the X- 



ray film by the film digitizer 18. The image data, for ex- 
ample, consists of an array of data obtained by dividing 
the X-ray film into a matrix of 1 .024 X 1 ,024 pixels and 
representing the density of each pixel by a digital 

s number of 10-bit. 

[0027] Fig. 4 shows the arrangement of. the film digi- 
tizer 18. The film digitizer 18 comprises a controller 40, 
an input device 42, a display device 43, a read-only 
memory (ROM) 44, an examination/relevant data stor- 

10 ing device 46, an image data storing device 48, a sem- 
iconductor memory 50, a film density detector 52, a cen- 
tral processing unit (CPU) 54, and a network interface 
(l/F) 56. Of these components, the controller 40, the in- 
put device 42, the display device 43, the ROfVI 44, the 

?5 examination/relevant data storing device 46, the image 
data storing device 48, the semiconductor memory 50, 
the film density detector 52, the CPU 54, and the net- 
work l/F 56 are connected to a control bus line 58. The 
ROM 44. the image data storing device 48, the semi- 

20 conductor memory 50, the film density detector 52, and 
the network l/F 56 are connected to an image bus line 
60. The network l/F 56 is connected to the network 16. 
[0028] The film density detector 52 divides an X-ray 
radiograph into a matrix of 1,024 X 1,024 pixels. The 

25 density detector 52 scans each pixel with a laser beam 
and measures the intensity of transmitted light to obtain 
the density of the pixel, thereby forming an intensity dis- 
tribution of the transmitted light of the X-ray radiograph. 
This intensity distribution is converted into digital inten- 
se sity data, and the data is supplied to the data storing 
device 48 through the image bus 60 and is stored therein 
as the image data. At the same time, examination data, 
together with relevant data, is stored in the examination/ 
relevant data storing device 46. At this time, the display 

55 device 43 displays a prompt message for urging a tech- 
nician to input an imaging direction of radiograph if the 
imaging direction is not input. When the text character 
denoting the imaging direction is input from the input de- 
vice 42 such as a keyboard, this data is written in the 

40 column of the imaging direction of relevant data (Fig. 5) 
stored in the storing device 46. 
[0029] Fig. 6 shows a practical example of the rele- 
vant data. The imaging direction of radiograph is de- 
fined, as shown in Fig. 7, such that when X-rays radiated 

45 from the back of a patient are detected on an X-ray film 
placed in front of the patient, the resulting image is re- 
ferred to as a front image. Similarly, a right-side (left- 
side) image is defined as an image obtained when X- 
rays radiated from the left (right) side of the patient are 

50 detected on a X-ray film placed on the right (left) side of 
the patient. When digitizing of one frame of the X-ray 
radiograph is completed, the image data and the corre- 
sponding relevant data are associated with each other 
by means of the image ID number. The examination da- 

55 ta and the corresponding relevant data are associated 
with each other by means of the examination I D number 
The image data, the corresponding examination data, 
and the corresponding relevant data are supplied to the 
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network 1 6 via the network I/F 56 and transferred to the 
data base 12 or the workstation 14 as data flowing 
through the network 16. 

[0030] Fig. 8 shows the arrangement of the data base 
12. The data base 12 comprises a CPU 62, a ROM 64. 
a semiconductor memory 66, a controller 68, a data re- 
trieving device (including an examination directory) 70, 
a data compression circu it 7 1 , an image data storing de- 
vice 72, and a network interface (I/F) 74. Of these com- 
ponents, the CPU 62, the ROM 64, the semiconductor 
memory 66, the controller 68, the data retrieving device 
70, the data compression circuit 71 , the image data stor- 
ing device 72, and the network I/F 74 are connected to 
a control bus line 76. The ROM 64. the semiconductor 
memory 66, the data compression circuit 71, the image 
data storing device 72, and the network I/F 74 are con- 
nected to an image bus line 78. The network I/F 74 is 
connected to the network 1 6. 
[0031] The image data, the corresponding examina- 
tion data, and the corresponding relevant data, which 
are flowing through the network 16, are input to the data 
base 1 2 via the network I/F 74, and stored in the image 
data storing device 72. If necessary, these data, partic- 
ularly the image data is temporarily stored in the semi- 
conductor memory 66 as a buffer memory. In this case, 
after the amount of the data is compressed to 1 /2 or 1 /1 0 
by the data compression circuit 71 , the data is stored in 
the image data storing device 72. The examination data 
and the relevant data are registered in the examination 
directory of the data retrieving device 70 to retrieve de- 
sired examination data and relevant data using an ex- 
amination ID and read out items of data. 
[0032] Fig. 9 shows an example of data contained in 
the examination directory of the data retrieving device 
70 of the data base 12. Referring to Fig. 9, reference 
symbol N denotes the number of images obtained in one 
examination. The examination directory is formed of ex- 
amination data (Fig. 2), address data for storing the 
reading report, amount of data of the reading report, and 
N number ol image data included in the examination. 
Each of the image data is formed of address data for 
storing the relevant data, amount of data of the relevant 
data, address data for storing the image data, amount 
of image data, and first CAD result to n-th CAD result. 
The CAD result is formed of a CAD ID number and ad- 
dress data for storing the CAD result. 
[0033] Next, an image reading operation performed 
by a doctor for the digital images whose attribute data 
are stored in the data base 12 as described above will 
be described. In hospitals, the image reading is per- 
formed to obtain a diagnosis result from medical imag- 
es. The image reading in the PACS is that images are 
displayed on a display device such as a CRT of the 
workstation 1 4 and a doctor makes a diagnosis from the 
displayed images or X-ray film obtained in the conven- 
tional X-ray radiography examination. 
[0034] When a doctor for image reading inputs his or 
her ID number with the power source of the workstation 



14 ON, the workstation 14 is set ready for receiving an 
image reading request. This is the same procedure as 
the log in operation in the conventional computer sys- 
tem. At this time, the workstation 14 sends a transfer 

5 request for images of a patient as an object to be image- 
read to the data base 1 2 on the basis of the examination 
ID input by the doctor or the examination ID which is 
registered in association with the doctor ID as shown in 
Fig. 10. If the patient has been examined, the worksta- 

io tion 14 may send a transfer request for images which 
have been read or viewed but are necessary to be re- 
ferred as well as images which is not read or viewed. 
The necessary images are retrieved by means of, for 
example, the data base 12. All the examination IDs re- 

15 lating to the patient ID and the necessary image data 
are determined using a logical procedure, for example, 
as shown in Fig. 11. The examination IDs having the 
same patient and the same modality are retrieved to 
make a list of the examination IDs. Alternately, the ex- 

20 amination IDs having the same patient and the same 
object are retrieved to make a list of the examination 
IDs. The examination IDs in one of the above two lists 
which has a high priority are sorted in the reverse chron- 
ological order. 

25 [0035] The data base 1 2 selects images in units of ex- 
aminations to be transferred by using the examination 
ID as a retrieval key. The selected image data in units 
of examinations or the compressed image data if the da- 
ta is read out from the storing deice 72, the relevant data, 

30 and the examination data in units of examinations are 
transferred to the network 1 6 via the network interface 
74, and in turn to the workstation 14 sequentially. 
[0036] A section for performing a CAD will be de- 
scribed below. The CAD is to obtain CAD data, for ex- 

35 ample, denoting a position of an abnormality in the im- 
age, by processing image data using a computer In this 
embodiment, for example, the workstation 1 4 serves as 
a section for obtaining the CAD data. 
[0037] Fig. 1 2 shows the arrangement of the worksta- 

40 tion 14. The workstation 14 comprises an input device 
80, an output device 82, an alarm generator 83. a hard 
disk interface (HD I/F) 84, a semiconductor memory 86, 
a CPU 88, a timer 90, a ROM 92, a network interface 
(LAN l/F) 94, a plurality of image memories 100. a plu- 

45 rality of CRT displays 102, a hard disk unit (HD) 106. 
and a data expansion circuit 1 08. Of these components, 
the input device 80, the output device 82, the alarm gen- 
erator 83, the HD I/F 84. the semiconductor memory 86, 
the CPU 88, the timer 90, the ROM 92, the LAN I/F 94, 

50 and the data expansion circuit 108 are connected to a 
control bus line 96. The output device 82, the alarm gen- 
erator 83. the HD l/F 84, the semiconductor memory 86, 
the ROM 92, and the LAN l/F 94 are connected to a high 
speed bus line 98. The LAN l/F 94 is connected to the 

55 network 16. 

[0038] The image memories 100 are provided in one- 
to-one correspondence with one or more (in this case, 
four) CRT displays 102. Each of the image memories 
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1 00 has two or three overlay screens (plane memories) 
and is connected to the output device 82. An output from 
the image memory 100 is displayed on the correspond- 
ing CRT display 102. The HD unit 106 is connected to 
the HD l/F 84. In the workstation 1 4. the image data input s 
via the LAN l/F 94 in the form of the compressed image 
data, the corresponding relevant data, and the exami- 
nation data in units of examinations are stored in the HD 
unit 106. 

[0039] In order to perform an image reading, a doctor io 
selects an image and the attribute data and the image 
is displayed on the CRT display 102 via the output de- 
vice 82. The image to be displayed is selected among 
the images for one examination using the image ID input 
by the doctor. If the compressed image data is read out '5 
from the HD unit 106. the compressed data is expanded 
by the data expansion circuit 1 08 and then stored in the 
semiconductor memory 86. The relevant data and the 
examination data are also stored in the semiconductor 
memory 86. The image data is read out from the semi- 
conductor memory 86 and is displayed on the CRT dis- 
play 1 02 to be read or viewed by the doctor. For exam- 
ple, when an object to be image-read is a conventional 
X-ray radiograph, front and side images are usually dis- 
played. When the patient has been examined, both non- 
read and past images (other than the non-read image; 
reference image) are usually displayed to perform com- 
parative image reading. 

[0040] The manner in which the images are displayed 
on the CRTs is registered in a CRT image display control 
table as shown in Fig. 1 4. The table is formed by asso- 
ciating the examination ID and the image ID with the se- 
rial number of the CRTs. The table is stored in the sem- 
iconductor memory 86. 

[0041] The image data which are sequentially trans- 
ferred to the workstation 14 from the data base 12 are 
sequentially processed with a predetermined CAD algo- 
rithm. 

[0042] A timing at which the.CAD operation is started 
will be described below. After image data, examination 
data, and relevant data of one patient are transferred to 
the HD unit 106 of the workstation 14, the examination 
data and relevant data are read out sequentially from 
the HD unit 1 06 to the semiconductor memory 86 by the 

cpuea 

. [0043] Since the CAD operation is performed in which 
one of a plurality of different CAD algorithms suitable for 
the image data is selected, the ROM 92 includes a table 

. indicating the name of a CAD algorithm and the items 
of the attribute data of the image data capable of being 
applied with the CAD algorithm, as shown in Fig. 15. 
The items of the attribute data of the image data to be 
analyzed and corresponding items of the attribute data 
of each CAD algorithm included in the table shown in 
Fig. 15 are compared with each other to determine 
whether or not the CAD algorithm can be applied to the 
image data. For example, a CAD algorithm for an inter- 
stitial lung disease is performed only when the modality 
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is a conventional radiograph, the examination object is 
a chest, the imaging direction is a front, and the result 
of CAD is nothing. If the CAD algorithm is not applied to 
the image data, nothing is stored in the item of the result 
of CAD. If other than nothing is stored in the item of the 
result of CAD, it means that the CAD algorithm is used 
for the image data. Therefore, since the examination da- 
ta (Fig. 2) and the relevant data (Fig. 6) are already read 
out into the semiconductor memory 86, the items of mo- 
dality and examination object are extracted from the ex- 
amination data, and the items of imaging direction and 
result of CAD are extracted from the relevant data. 
These items are compared with items for each algorithm 
stored in the table shown in Fig. 1 5. The table of Fig. 1 5 
is read out from the ROM 92 and is stored in the semi- 
conductor memory 86. If they are equal to each other, 
the image is determined to be an object to which the 
CAD algorithm is to be applied. Therefore, an arithmetic 
operation of the CAD algorithm corresponding to the im- 
age data is started. 

[0044] First, the image data determined to be an ob- 
ject to which the CAD algorithm is to be applied is read 
out into the semiconductor memory 86. The CPU 88 ex- 
ecutes the CAD algorithm stored in the ROM 92 and 
stores the result of CAD in the semiconductor memory 
86. The CPU 88 issues a serial number for the CAD ID 
and writes the CAD ID for retrieving the result of CAD 
in the item of the result of CAD in the relevant data (Fig. 
6) stored in the semiconductor memory 86. The CPU 88 
also writes the address storing the result of CAD in the 
relevant data. The default data of the address of the re- 
sult of CAD is text data denoting nothing. When the op- 
eration for one CAD algorithm is ended, it is determined 
whether the next CAD algorithm can be applied to the 
image data. 

[0045] The examples of the CAD algorithm written in 
the ROM 92 are as follows. A CAD algorithm for detect- 
ing a micro calcification in mammography is disclosed 
in Unexamined Japanese Patent Application No. 
2-152443. A CAD algorithm for measuring the size of 
the heart and lung is disclosed in United Stales Patent 
Application No. 275,720 (filed November 23. 1988). A 
CAD algorithm for detecting an interstitial lung disease 
is formed of the following algorithms: 

#1: An algorithm (which is schematically shown in 
Fig. 17, and illustrated in detail in Fig. 1 8) for setting 
ROIs (symbolized by □ in Fig. 16) for the CAD al- 
gorithm for one frame of the image data. 
#2: An algorithm (which is schematically shown in 
Fig. 1 9) for calculating a physical amount of texture 
(which is an index indicating the magnitude and the 
length of period of a density variation in a texture 
pattern) in the ROI. 

#3: An algorithm (the flow chart of which is shown 
in Fig. 20, and the arrangement in Fig. 21) for ap- 
plying a threshold to the calculated physical amount 
of texture to determine abnormality or normality of 
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the ROI. 

[0046] Of these algorithms, the algorithms #1 and #2 
are described in USP 4.851,984. and therefore a de- 
tailed description thereof will be omitted. In addition, 
since the algorithms #3 is described in USP 4,839.807. 
a detailed description thereof will be omitted. 
[0047] The results of the CAD algorithm and the clas- 
sification of the normality are temporarily stored in the 
semiconductor memory 86. The detailed description for 
the case of the interstitial lung disease will be described. 
It is to be noted that "diffuse" is determined for those 
classified to be abnornnat (i.e., those determined to be 
clustered abnormal ROIs in the flowchart shown in Fig. 
20) because of the presence of clusters (grouped ab- 
normal ROIs). and "locar is determined for abnormali- 
ties other than these; they are called patterns of abnor- 
mality. The pattern of abnormality is included as one 
item in the result of CAD of Fig. 22. and the type of pat- 
tern is written in this item as text characters, e.g., denot- 
ing local. Fig. 23 shows a practical example of the result 
of CAD in the case of an abnormal ROI. Here, a TPF 
represents a true positive fraction and an FPF repre- 
sents a false positive fraction, failure. The ID of the result 
of CAD and the address of this CAD result data in the 
semiconductor memory 86 are additionally written as 
items in the relevant data (Fig. 5). When the result of 
CAD is stored in the data base 1 2, the ID and address 
are registered in the examination directory as shown in 
Fig. 9. The above operation is performed plural times if 
plural CAD algorithms can be applied to the image data. 
If plural results of CAD and addresses are obtained, all 
the plural IDs and addresses are stored in the examina- 
tion directory. 

[0048] The CAD result is output in response to appli- 
cation of an output request trigger. Therefore, while im- 
age reading is performed (a conventional X-ray radio- 
graph of a chest is read or viewed in case of interstitial 
lung disease detection CAD), various commands in- 
cluding this output request must be input from the input 
device 80 of the workstation 1 4. In this' embodiment, the 
description of the input device 80 will be given by using 
a touch panel type device. It is also possible to use a 
general device, such as a keyboard as the input device 
80. 

[0049] Fig. 24 shows an example of the input device 
80. This touch panel comprises a command display 110 
on which the names of commands is displayed, a panel 
1 1 2 on which the command display 1 1 0 is arranged, and 
a transparent sensor board 114 located on the com- 
mand display 1 1 0. When a position corresponding to the 
name of a command is selectively touched with a finger, 
the sensor board 114 senses the touched portion. 
[0050] When, for example, several command buttons 
are displayed on the output device, an operator can rec- 
ognize a command display through the sensor board 
114. The operator selects a command by touching the 
sensor board 114, thus executing the command. A but- 



ton (CAD button shown in Fig. 25) for requesting an out- 
put of a result of CAD is prepared (displayed) on the 
touch panel. Detecting depression on this CAD button 
on the touch panel is a trigger for requesting the CAD 

5 result output. 

[0051] Since the CAD result can be output in various 
modes, the mode of outputting the CAD result is deter- 
mined next. The CPU 88 reads out the relevant data 
(Fig. 6) corresponding to the examination ID and image 

10 ID included in the CRT image display control table (Fig. 
14). Further, the CPU 88 reads out the CAD result ID 
and CAD result address from this relevant data, thereby 
reading out or retrieves the result of CAD (Fig. 22). 
[0052] An example of CAD result output is described 

15 below. The CPU 88 starts the program in the ROM 92 
and outputs a CAD result (Fig. 23) relating to the abnor- 
mality to a corresponding output device according to the 
pattern of the abnormality In this program, the item of 
data denoting the pattern of abnormality is extracted 

20 from the result of CAD (Fig. 23) relating to the abnor- 
mality and stored in the semiconductor memory 86. If 
the pattern of abnomnality is a diffused pattern, a text 
sentence generator is activated in order to output an ab- 
normality alarm in the form of a text sentence. If the pat- 

25 tern of abnormality indicates local, the alarm (marker) 
generator 83 is activated in order to indicate the location 
of abnormality by means of a marker. 
[0053] In this case, the text sentence represents the 
location of abnormality on an image by means of words, 

30 thereby making an alarm. For this purpose, as shown in 
Fig. 26, a screen of the display is equally divided into 
six regions in advance, and a name is assigned to each 
region. A table (Fig. 27) showing a correspondence be- 
tween the names and the x, y coordinates of the regions 

35 is stored in the ROM 92. The right and left is defined as 
viewed from the patient. The CPU 88 starts the program 
in the ROM 92. In this program, the x. y coordinates of 
the location of the abnormal ROI is extracted from the 
CAD result and an expression of abnonnality is read out 

40 from the table shown in Fig. 28 and stored in the ROM 
92 in accordance with the location of the abnormality 
The readout expression data is stored in the semicon- 
ductor memory 86 to be inserted into the text sentence. 
If plural CAD results are obtained, the above operation 

45 is repeated for the number of the CAD results. The text 
sentence is, for example, "interstitial lung disease, up- 
per right lung abnormal." In this case, the expression of 
the underlined portion changes in accordance with an 
abnormal portion. Subsequently,' character string data 

so of the text sentence is converted into dot patterns in 
units of characters. Thereafter, with reference to the 
CRT image display control table (Fig. 14), one text line 
(white) is provided in the uppermost stage of an image 
memory 100 (overlay screen) corresponding to the CRT 

55 displaying the image, and dot patterns of black charac- 
ters are stored in the text line of the image memory 100. 
as shown in Fig. 29. 

[0054] The marker is a means for representing the lo- 
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cation ot abnormality on an image by using an arrow. 
The CPU 88 of the workstation 14 starts the program in 
the ROM 92 and reads out the location of abnormality 
from the CAD result data (Fig. 22), thus forming the 
shape of a marker as shown in Fig. 29, based on a font 5 
pattern of the ROM 92. In this case, although d (diagonal 
of the square) = 1 .5 cm is preferable, d is not limited to 
this value but can be changed freely. The screen is di- 
vided Into right and left portions as viewed from the op- 
erator. If the location (the center of ROI indicated by a 
symbol X) of abnormality is present on the right side of 
the screen, the arrow shown in Fig. 30 is converted di- 
rectly into a bit pattern. If, by contrast, the location is 
present on the left side, the arrow of Fig. 30 is inverted 
symmetrically about a longitudinal line (alternate long 
and short dashed line in Fig. 30) including the center of 
ROI, i.e., in a mirrorlike manner and the resulting mirror 
image of the arrow as indicated by a broken line in Fig. 
30 is converted into a bit pattern. 
[0055] In addition, the bit pattern data is written in a 
location corresponding to the position of abnormality in 
the image memory 100 (overlay memory) correspond- 
ing to the CRT displaying the image. It a plural CAD re- 
sults are obtained, the above operation is repeated until 
allthe CAD results are read out and written into the over- 25 
lay memory. The data in the image memory 1 00 (overlay 
memory) is displayed on the CRT overlapped with the 
image data. The display color of the bit pattern data of 
the marker is switched between black and white in syn- 
chronism with the timer 90. Thus, the effect of alarming 30 
of the marker is enhanced. It is noted that the period of 
switching is 2Hz. 

[0056] At this time, though all the CAD results are si- 
multaneously displayed on the CRT, some of them may 
be selectively displayed. The names of buttons dis- ^5 
played on the touch panel are changed in accordance 
with the needs of the operator For example, the names 
of the buttons are changed in accordance with the CAD 
algorithm now applying to the image data. A label "ID", 
"MC", and "BH" are provided for buttons in case of an 40 
interstitial lung disease detection CAD, micro calcifica- 
tion detection CAD, and heart size measuring CAD, 
When a CAD algorithm is selected, the CAD result cor- 
responding to the algorithm is writteri in the overlay 
memory and the other results are deleted from the over- ^5 
lay memory. 

[0057] Another mode of CAD result output will be de- 
scribed in which the CAD result has a hierarchical struc- 
ture. That is, a summary of the CAD result is output first 
by means of, e.g., the text sentence and the marker as 50 
described above, and then details are output. For this 
purpose, a button for requesting a CAD detail output is 
prepared on the input device (touch panel) 80 (Fig, 25) 
of the workstation 14. In other words, the names of but- 
tons on the touch panel are changed in accordance with 55 
the application used by an operator. When depression 
on the CAD detail output button on the touch panel is 
sensed while the text sentence and the marker are dis- 



played, a trigger for requesting an output of the CAD 
detailed result is generated. 

[0058] The output of the CAD detailed result will be 
described below. It is assumed that the text sentence is 
already formed and stored in the form of black charac- 
ters on a white background as shown in Fig. 29 in the 
image memory 100 (overlay screen). The CPU 88 starts 
the program in the ROM 92 to read out the CAD result 
data (Fig. 22) from the semiconductor memory 86. The 
CPU 88 forms an arrow marker for data having abnor- 
mality independently of the pattern of the abnormality 
The marker indicates the location of the abnormality on 
an image by means of an arrow. 
[0059] The CPU 88 reads out the location of the ab- 
normality and forms the shape of the marker as shown 
in Fig. 31 , based on the font pattern in the ROM 92. At 
this time, the screen is divided into right and left portions. 
If the abnormality location is present on the right skJe 
viewed from the operator, the arrow of Fig. 31 is con- 
verted directly into a bit pattern. If, on the other hand, 
the abnormality location is present on the left side, the 
arrow of Fig. 31 is mirrorlike-inverted symmetrically 
about a longitudinal line (alternate long and short 
dashed line in Fig. 31) including the location of the ab- 
normality, and the resultant mirrorlike arrow as indicated 
by a broken line in Fig. 31 is converted into a bit pattern. 
In addition, the type (e.g., nodular) and the degree (e. 
g.. 75%) of the abnormality are read out from the CAD 
result data and are converted into a bit pattern, as shown 
in Fig. 31 . Unlike the bit pattern of the arrow, the bit pat- 
tern of characters of the type and degree is not mirror- 
like-inverted regardless of whether the abnormality lo- 
cation is present on the right side or the left side. 
[0060] This bit pattern data is written in a location cor- 
responding to the position of the abnormality in the im- 
age memory 100 (overlay screen) corresponding to the 
CRT 102 displaying the image. As a result, the arrow 
marker associated with the characters indicating the 
type and the degree of the abnormality (Fig. 31 ) is dis- 
played, together with the text sentence shown in Fig. 29, 
on the screen. 

[0061] The data in the image memory 100 (overlay 
screen) is displayed overlapped on the examination im- 
age. At this time, the color of the data display on the 
overlay screen is switched between black and white in 
synchronism with the timer 90. The period of switching 
is 2Hz. 

[0062] An example of an option output of the CAD de- 
tailed result will be described below. As in the case of 
the trigger for the detailed output, a button for requesting 
a detailed option output of the CAD result is displayed 
on the input device (touch panel) 80 of the workstation 
14 as a trigger for the option output. When depression 
on the CAD detailed option output button on the touch 
panel is sensed while the detailed output is performed, 
the trigger for requesting the CAD detailed option output 
is attained. 

[0063] It is supposed that the text sentence is already 



8 



15 



EP 0 487 110 B1 



16 



formed and stored in the form of black characters on a 
white background as shown in Fig. 29 in the image 
memory 100 (overlay screen). The CPU 88 starts the 
program in the ROM 92 to read out the CAD result data 
(Fig. 22) from the semiconductor memory 86 and forms 
an arrow marker for data having abnormality independ- 
ently of the pattern of the abnormality This marker rep- 
resents the location of the abnormality on the image by 
means of an arrow. 

[0064] The CPU 88 reads out the location of the ab- 
normality and forms an arrow marker and a square ROI 
marker, as shown in Fig. 32, based on the font pattern 
of the ROM 92. Here, the screen is divided into right and 
left portions. If the abnormality location is present on the 
right side, the arrow and the ROI of Fig. 32 are converted 
directly into bit patterns. If the location is present on the 
left side, the arrow of Fig. 32 is inverted in a mirrorlike 
manner, and the resulting arrow indicated by a broken 
line in Fig. 32 and the ROI are converted into bit pat- 
terns. This bit pattern data is written in the location cor- 
responding to the position of the abnormality in the im- 
age memory 100 (overlay screen) corresponding to the 
CRT displaying the image in the CRT display image con- 
trol table (Fig. 12). 

[0065] The data in the image memory 100 (overlay 
screen) is displayed overlapped on the examination im- 
age. At this time, the color of the data display on the 
overlay screen is switched between black and white in 
synchronism with the timer 90. The period of switching 
is 2Hz. 

[0066] Another example of the option output will be 
described. When another option output is requested, the 
CPU 88 starts a given program in the ROf^ 92 to read 
out ROC (Receiver Operator Cun/e) data included in the 
CAD result from the semiconductor memory 86. thus 
forming an ROC cun/e. As shown in Fig. 33, the ROC 
curve is one of examples for indicting the ability of CAD 
and is so formed as to be fitted in a portion below and 
to the right of the image. In the ROC curve, the abscissa 
denotes the FPF and the ordinate denotes the TPF. The 
ROC curve is converted into a bit pattern. The bit pattern 
data is written in the image memory 100 (overlay 
screen) corresponding tothe CRT displaying the image. 
The data in the image memory (overlay memory) 100 is 
displayed on the CRT overlapped with the examination 
image. 

[0067] An example of a request trigger for ending the 
output of the CAD result will be described below. When 
. the image reading of a conventional X-ray radiograph of 
a chest is performed and the image and the CAD result 
are displayed on a CRT screen, the trigger for ending 
the CAD result output is automatically generated upon 
stopping the image display in order to display another 
image. When the output is ended, the image display is 
continued, and only the display on the overlay screen is 
turned off. Further, the touch panel may include a button 
for providing the command representing the end of the 
image reading and the relevant data is updated as being 



read if the button is depressed. 
[0068] A command for requesting the end of the CAD 
output can also be applied from the input device 80 of 
touch panel type. 

s [0069] It is to be noted that the CAD data is preferably 
stored even when its output (display) is stopped. The 
CAD result is added to the updated relevant data, as 
shown In Fig. 34. and supplied to the data base 12 to 
be stored therein. In the data base 12. all the CAD IDs 

10 and CAD result addresses in the relevant data are 
stored in the examination directory (Fig. 9). In a subse- 
quent image reading, if an image transfer request is sup- 
plied to the data base 1 2, the image data and the cor- 
responding examination and relevant data are trans- 

15 ferred by the network 16 and stored in the semiconduc- 
tor memory 86 of the workstation 1 4. At the same time, 
the CAD result ID is read out and all the CAD results are 
retrieved based on the CAD IDs. In this case, as shown 
in Fig. 35, the address of the CAD result written in the 

20 relevant data is converted into the address on the sem- 
iconductor memory 86 and is stored in the relevant data. 
[0070] According to this embodiment as has been de- 
scribed above, the following effects can be obtained. 
That is, in addition to a medical image, CAD data con- 

25 cerning the image is also displayed. Therefore, an erro- 
neous diagnosis due to an oversight of a disease can 
be prevented in medical image diagnosis, thus increas- 
ing diagnosis precision. Labors can be reduced in a di- 
agnosis operation performed by a doctor (operator), in 

30 medical image diagnosis, particularly in an image read- 
ing operation, an erroneous diagnosis caused by an 
oversight of a disease can be prevented to improve di- 
agnosis precision. Since the CAD data is obtained by 
analyzing medical images using a computer, objective 

35 and quantitative resu Its can be obtained. Therefore, it is 
possible to prevent an erroneous diagnosis which is a 
result of subjective determination by a human being, 
and consequently diagnosis precision can be increased. 
In medical image diagnosis, a doctor who is not an ex- 

40 pert of an image of interest sometinies cannot make a 
satisfactory diagnosis. According to the present inven- 
tion, diagnosis precision can be improved also in this 
case. 

[0071] As the CAD data, the position, the type, or the 
45 degree of abnormality is displayed, so that the abnor- 
mality can be readily recognized. As a result, an erro- 
neous diagnosis caused by an oversight of a disease 
can be prevented to improve diagnosis precision. 
[0072] Arithmetic operation calculating the CAD data 
50 is started by a computer before an output request for the 
CAD data is generated. Therefore, it is possible to short- 
en a time from generating the output request to display- 
ing the CAD data. 

[0073] When several algorithms for obtaining CAD 
55 data are available, an inappropriate processing is per- 
formed for an image data of interest unless the image 
data is correctly assigned to the algorithm, and errone- 
ous CAD data results. According to this embodiment, 
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however, since a suitable algorithm is selected for each 
image, output of erroneous CAD data can be prevented 
to increase diagnosis precision. 
[0074] Since the CAD result is stored in the data base 
12, an image which is diagnosed once need not be an- s 
alyzed again. 

[0075] A CAD algorithm is determined for each diag- 
nosis of interest, and the algorithms are selectively ex- 
ecuted in accordance with each object. Therefore, it Is 
possible to prevent a production of CAD data which may 
cause an erroneous diagnosis in the case when an un- 
suitable algorithm is applied to an object. Further, the 
attribute data includes the modality, the examining ob- 
ject, and the imaging direction, and an algorithm is ex- 
ecuted when these items of the attribute data coincide '5 
with those of an object image of the algorithm. There- 
fore, an unsuitable algorithm is not applied to the image. 
[0076] An alarming means which strongly attracts at- 
tention of the doctor is used as a means for alarming 
abnonmality. Therefore, an erroneous diagnosis due to 20 
an oversight can be prevented to increase diagnosis 
precision. An optimal alarming means is selected to at- 
tract attention in accordance with the type of abnormal- 
ity. Therefore, it is possible to prevent an erroneous di- 
agnosis caused by an oversight, thus improving diagno- 25 
sis precision. By flickering the alarm display, the alarm- 
ing means strongly attracts attention to prevent an erro- 
neous diagnosis resulting from an oversight, thus im- 
proving diagnosis precision. 

[0077] The CAD data is hierarchically constructed 30 
and output gradually from its summary to details. There- 
fore, a large number of different types of CAD data are 
not simultaneously displayed to cause a cumbersome 
operation. Thus, an erroneous diagnosis can be pre- 
vented to increase diagnosis precision. For example, 
the position of abnormality alone is output first as the 
CAD data. If the abnormality cannot be clearly deter- 
mined, a doctor freely makes output requests for. e.g., 
the degree, the type, and the pattern of the abnormality, 
thus avoiding a cumbersome operation to increase di- 
agnosis precision. In this case, a usable command (but- 
ton) is prepared for each level (hierarchical level) of con- 
tents at which the CAD data is output. Since a user need 
only select a command of interest from the prepared 
commands, a labor for selecting from a large number of 
commands is reduced. 

[0078] Before application of the CAD algorithm to a 
given image data, it is determined whether the CAD al- 
gorithm can be applied to the image data based on the 
attribute data of the image data and only the algorithm 
which is determined to be able to apply to the image 
data is applied to the image data. Therefore, it is possi- 
ble to prevent lowering the quality and precision of di- 
agnosis due to the output of the erroneous CAD data. 
[0079] The CAD system according to the present in- 
vention is described as being incorporated into the 
PACS. However, it is possible to realize a stand-alone 
type CAD system according to the present invention. 



[0080] Plural CAD algorithms are stored in the system 
and an optimum one is automatically selected based on 
the relevant data of the object image data. Therefore, it 
is possible to reduce the labors of the doctor for select- 
ing the suitable algorithm, inputting the respective im- 
age data, and outputting the respective CAD data. 
[0081 ] The computer starts an arithmetic operation for 
calculating the CAD data before an output request for 
the CAD data is generated. Therefore, it is possible to 
shorten a time from generating the output request to dis- 
playing the CAD data. 

[0082] The numerical data denoting the CAD result in- 
cludes many items. If all the data are output, the output 
becomes complicate. According to the first embodi- 
ment, the CAD data are stored in the form of a table and 
only desired data is output by retrieving the data from 
the table using the retrieval key corresponding to the de- 
sired condition. Therefore, the CAD result can be output 
In a simple form. 

[0083] The attribute data includes an item of data de- 
noting whether or not the image data has been read or 
viewed. Based on this attribute data, the CAD result of 
the image data which has been read or viewed is not 
output. Therefore, it is possible to prevent a confusion 
in which the CAD result different from the reading report 
is output. Based on this attribute data, only the image 
data which has not been read or viewed is analyzed us- 
ing the CAD algorithm. Therefore, a time from generat- 
ing the output request to displaying the CAD data be- 
comes shorter than that In the case of all the image data 
are analyzed. Further, the attribute data includes an item 
of data representing the CAD result and the image data 
which has been analyzed is not analyzed again. There- 
fore, it is possible to further shorten a time from gener- 
ating the output request to displaying the CAD data. 
[0084] Other embodiments of the present invention 
will be described below. 

[0085] A second embodiment comprises, in addition 
to the workstation 1 4 for displaying the image as shown 
in Fig. 12, a workstation 14a having a CAD processor 
120 as shown in Fig. 36. This workstation 14a for ob- 
taining CAD data is different from the workstation 14 in 
that a controller 90a is provided in place of the timer 90. 
In terms of an operation, the second embodiment Is dif- 
ferent from the first embodiment in a timing at which a 
CAD arithmetic operation is started. 
[0086] In the second embodiment, when image data, 
examination data, and relevant data of one patient are 
transferred, to the HD unit 106 of the workstation 14a, 
the examination data and the relevant data are read out 
sequentially from the HD unit 106 into the semiconduc- 
tor memory 86 by the CPU 88. The ROM 92 stores the 
table denoting the relationship between the name of the 
CAD algorithm and the attribute data of the image data 
which can be adapted to the CAD algorithm as shown 
in Fig. 15. Therefore, since the examination data (Fig. 
2) and the relevant data (Fig. 6) are already read out 
into the semiconductor memory 86, the modality and the 
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examining object are read out fronn the examination da- 
ta, and the Imaging direction is read out from the rele- 
vant data. These read out items of data are stored in the 
semiconductor memory 86. These items of data are 
compared with the attribute data of the image stored in 5 
the table (Fig. 15) of the ROM 92. 
[0087] If these items are coincide with those of a given 
CAD algorithm, e.g., interstitial lung disease detection 
CAD, this image is determined to be an image to which 
the interstitial lung disease detection CAD algorithm can io 
be applied, and the operation of the CAD is started. At 
this time, the CPU 88 in the workstation 1 4a designates 
activation of the CAD processor 120 (Fig. 36). and sup- 
plies input data to the processor 1 20. The input data giv- 
en to the CAD processor 1 20 includes the image data, '5 
the examination data, and the relevant data. The CAD 
processor 120 has its own CPU, and by means of the 
CPU it executes the CAD operation and outputs a CAD 
result. The CAD result is temporari ly stored in the mem- 
ory as data having the format shown in Fig. 22. In addi- 20 
tion, the ID and the address of the CAD result data are 
additionally written in the relevant data (Fig. 6). 
[0088] As described above, according to the second 
embodiment, since the display and the CAD arithmetic 
operation are separately performed at different worksta- 25 
tions 1 4 and 1 4a, a processing time for the CAD can be 
shortened. That is, if a CAD processing is performed at 
devices such as the modality 1 0, the workstation 1 4, and 
the data base 12, a long processing time is required for 
they share a single CPU . However, since the CAD proc- 
essor 1 20 has a CPU 88 for a processing purpose only, 
the processing time is shortened. 
[0089] A third embodiment is different from the first 
embodiment in that a CAD result is output as a sound. 
For this purpose, a workstation of this embodiment has 35 
a sound generator as shown in Fig. 37 in addition to the 
arrangement shown in Fig. 10. The CPU 88 of the work- 
station 1 4 reads out relevant data using the CRT image 
display control table (Fig. 14). The CPU 88 also reads 
out CAD results (Fig. 22) by reading out the CAD result 40 
address from the relevant data. When the CAD result is 
to be output, the CPU 88 starts a program in the ROM 
92 and assigns the CAD result having abnormality to a 
corresponding output device in accordance with the pat- 
tern of the abnormality In this program, the CAD results ^5 
and the classification of the CAD result are read out from 
the semiconductor memory 86. and, if the type of abnor- 
mality indicates "diffuse", a text sentence generator is 
. activated in order to output an abnormality alarm in the 
form of a text sentence. If the type of abnormality indi- so 
cates "local", a marker generator and the sound gener- 
ator shown in Fig. 37 are activated in order to indicate 
the position of the abnormality by means of a marker 
and a sound. 

[0090] When the CAD operation result is read out S5 
from the semiconductor memory 86, if the pattern of ab- 
normality indicates "local", a sound of "abnormality 
present" is simply generated. If, however, the pattern of 



abnormality indicates "diffuse", a statement formed as 
a text sentence is automatically read. The text sentence 
is. for example, "interstitial lung disease, upper right 
lung abnormal." The expression in the underlined por- 
tion changes in accordance with an abnormal portion. 
Next, the CPU 88 activates a progrann in the ROM 122 
and converts character string data in the text sentence 
into a voice sound. "Interstitial lung disease, upper right 
lung abnormal" is stated by generating three groups of 
words, interstitial luna disease, upper right lung , and ab- 
normal. Since the expression in the underlined portion 
changes in accordance with an abnormal portion as de- 
scribed above, a sound data base 124 is also provided 
to generate words for this purpose. 
[0091] According to the third embodiment as de- 
scribed above, in specifying the position of abnormality 
by means of a sentence or a sound, words representing 
a position are used to make it easy to recognize the ab- 
normality. Therefore, an oversight of a disease and con- 
sequently an erroneous diagnosis can be prevented to 
lead to an increase in diagnosis precision. 
[0092] As a fourth embodiment, an embodiment of au- 
tomatically outputting a CAD result will be explained. 
The arrangement of a workstation of the fourth embod- 
iment is identical to that of the first embodiment shown 
in Fig. 12. In the fourth embodiment, however, even if 
no CAD result request is present during irnage reading 
of a conventional X-ray radiograph of chest, the result 
is automatically displayed. 

[0093] For this purpose, each time an image is dis- 
played, the CPU 88 refers to the CRT image display con- 
trol table (Fig. 1 4) and checks whether the I D of the CAD 
result is included in the relevant data of the displayed 
image, i.e., whether nothing is stored in the CAD result 
ID, and in this manner checks whether the displayed im- 
age is an object of the CAD. If the CPU 88 determines 
that the displayed image is an object of the CAD, it 
measures a predetermined time from the start of image 
display by means of the timer 90, and automatically gen- 
erates a trigger for requesting a CAD result output when 
the predetermined time has elapsed. This predeter- 
mined time can be arbitrarily changed. 
[0094] In this manner, the output request for the CAD 
data can be omitted, and this results in a reduction in 
labors. In addition, if the CAD data is output immediately 
after an image is displayed, an operator or doctor may 
have a preconceived knowledge. Therefore, CAD data 
is output when a certain time has elapsed after an image 
is displayed. As a consequence; an erroneous diagno- 
sis due to an oversight is prevented to improve diagno- 
sis precision. 

[0095] A fifth embodiment as another example of au- 
tomatically outputting the CAD result will be described. 
Here, the arrangement of a workstation of this embodi- 
ment is also the same as that shown in Fig. 12. First, 
each time an image is displayed, the CPU 88 refers to 
the CRT image display control table (Fig. 14) and 
checks whether the ID of the CAD result is included in 
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the relevant data of the displayed image, i.e., whether 
nothing is stored in the CAD result ID, and in this manner 
checks whether the displayed image is an object of the 
CAD. If the CPU 88 determines that the displayed image 
is an object of the CAD, it measures a number of times 
(the number of applications of the CAD algorithm) at 
which the image is displayed from the start of the image 
reading for the patient and writes the number of times 
into the relevant data (Fig. 6). The number of times is 
initially set to zero and increased by one every time the 
image is displayed. The CPU 88 automatically gener- 
ates a trigger for requesting a CAD result output when 
the number of times reaches a predetermined time 
which can be arbitrarily set. 

[0096] In this manner, since an output request for 
CAD data can be omitted, labors can be reduced. In ad- 
dition, if CAD data is output immediately after an image 
is displayed, an operator or doctor may have a preoc- 
cupied knowledge. Therefore, CAD data is not output 
when an image is displayed for the first time and image 
reading is performed but output when the image is dis- 
played for a predetermined time or the image display is 
switched. The result is that an erroneous diagnosis 
caused by an oversight is prevented to improve diagno- 
sis precision. 

[0097] The fourth and fifth embodiments are embod- 
iments automatically outputting a CAD result. Next, a 
sixth embodiment of automatically ending outputting of 
a CAD result will be described. The arrangement of a 
workstation of this embodiment is identical to that shown 
In Fig. 12. When, for example, image reading of a con- 
ventional radiograph of a chest is performed, a display 
of the CAD result is automatically stopped even if no 
CAD result request is present. For this purpose, each 
time an image is displayed, the CPU 88 refers to the 
CRT image display control table (Fig. 14) and checks 
whether the ID of the CAD result is included in the rele- 
vant data of the displayed image, i.e., whether nothing 
is stored in the CAD result I D, and in this manner checks 
whether the displayed image is an object of the CAD. If 
the CPU 88 determines that the displayed image is an 
object of the CAD, it measures a predetermined time 
from the start of image display by means of the timer 90, 
and automatically generates a trigger for requesting the 
end of the CAD result output when the predetermined 
time has elapsed. This predetermined time can be arbi- 
trarily changed. Upon the end of outputting, the CPU 88 
turns off all overlay screens displayed on CRTs. 
[0098] According to this embodiment, since an output 
end request for CAD data can be omitted, labors are 
reduced. In addition, CAD data remaining on an image 
for a long time makes it difficult for an operator or doctor 
to observe details of an image. As in this embodiment, 
however, by automatically ending display of CAD data 
after the data has been displayed for a predetermined 
time, an erroneous diagnosis is prevented to increase 
diagnosis precision. 

[0099] Various commands must be input in the 



present invention, so a seventh embodiment relating to 
a modification of the input device will be described, be- 
low. During image reading of a conventional radiograph 
of a chest, when an icon displayed on a CRT screen is 

5 designated (clicked) by a pointing device such as a 
mouse, a menu window as shown in Fig. 38A appears 
at a corner, in this case, the upper right corner of the 
screen. It is to be noted that this menu window shows 
only buttons which can be used by an operator at the 

10 time of click. If it is electrically sensed that a CAD button 
in the menu window on the screen is designated by the 
pointing device, a trigger for requesting a CAD result 
output is generated. 

[01 00] Similarly, when the icon displayed on the CRT 

^5 screen is designated (clicked) by the pointing device 
such as a mouse, as shown in Fig. 38B, while the CAD 
output is performed, the menu window emerges. If a but- 
ton for requesting a CAD detail result output in the menu 
window is designated, a trigger for requesting the CAD 

20 detail result output is generated. When the icon dis- 
played on the CRT screen is designated (clicked) by the 
pointing device such as a mouse while the CAD output 
is performed, the menu window appears. If a button for 
requesting an option output in the menu window is des- 

25 ignated. a trigger for requesting an option output is gen- 
erated. When the icon displayed on the CRT screen is 
designated (clicked) by the pointing device such as a 
mouse while the CAD output is performed, the menu 
window emerges. If a button for requesting a CAD diag- 

30 nosis level output in the menu window is designated, a 
trigger for requesting the CAD diagnosis level output is 
generated. When the icon displayed on the CRT screen 
is designated (clicked) by the pointing device such as a 
mouse while the CAD output is performed, the menu 

35 window appears. It a button for requesting a CAD result 
output end in the menu window is designated, a trigger 
for requesting the CAD detail output end is generated. 
Upon the end of outputting, overfay screens are turned 
off. 

40 [0101] According to this embodiment as described 
above, a menu window including buttons having com- 
mand names is displayed on the CRT screen. By des- 
ignating a command with by means of a pointing device 
such as a mouse, a command for outputting CAD data 

45 can be input. In addition, since the menu window is not 
constantly displayed but can be selectively displayed, 
an operator (doctor) can display commands only when 
he or she needs them. Therefore, an annoyance caused 
by frequent changes in commands displayed can be re- 

50 duced. In this case, a usable menu is prepared for each 
level (hierarchical level) of the contents of CAD data to 
be output. Therefore, since a user need only select a 
menu of interest from the prepared menus, a labor of 
selecting from a large number of menus is reduced. 

55 [0102] An eighth embodiment concerned with color- 
ing of a marker and a text sentence will be described 
below. The arrangement of a workstation is the same as 
that shown in Fig. 12. With reference to the CRT image 
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display control table (Fig. 14), an overlay screen corre- 
sponding to a CRT not having "nothing" in the ID of the 
CAD result of relevant data of a displayed image is over- 
laid on the examination image displayed on the CRT. At 
this time, the data displayed on the overlay screen is 
flickered in an arbitrary color, such as red, while being 
synchronized by the timer 90. The period of flickering is 
2 Hz. 

[0103] According to the eighth embodiment, It is pos- 
sible to strongly attract attention because of the color of 
the alarm display. As a result, an erroneous diagnosis 
caused by an oversight can be prevented to conse- 
quently increase diagnosis precision. This effect can be 
further enhanced by flickering the alarm display. 
[0104] A ninth embodiment in which a CAD arithmetic 
operation is started by the modality, such as a film dig- 
itizer 18 (Fig. 4) will be described. The arrangement of 
a workstation is identical to that shown in Fig. 12. In this 
embodiment, when the film digitizer 18 digitizes all the 
image data for one patient and inputs the imaging direc- 
tion, the CPU 88 reads out examination data and rele- 
vant data sequentially from the HD unit 1 06 into the sem- 
iconductor memory 86. In order to refer to the table (Fig. 
1 5) of CAD algorithms and corresponding attribute data, 
the modality and the examination object are read out 
from the examination data (Fig. 2) and the imaging di- 
rection and the CAD result ID address are read out from 
the relevant data (Fig. 6). These readout items of data 
are stored in the semiconductor memory 86. These 
items of data are compared with the attribute data of the 
image stored in the table (Fig. 15) of the ROM 92. If 
these items are coincide with those of a given CAD al- 
gorithm, this image is determined to be an image to 
which the given CAD algorithm can be applied, and the 
operation of the CAD is started. 
[0105] Upon the start of the CAD operation, image da- 
ta determined to be an object of the CAD is read out into 
the semiconductor memory 86. The CPU 88 executes 
a CAD operation program written in the ROM 92 and 
stores the result in the semiconductor memory 86. The 
CPU 88 transfers, as data flowing through the network 
16, the image data, the relevant data, the CAD result, 
and the examination data (for each examination) to the 
data base 12 via the LAN l/F 94. As shown in Fig. 34, 
the data base 12 handles the CAD result data as a part 
of the relevant data. 

[01 06] When data is transferred to the workstation 1 4 
during image reading, the transferred data is temporarily 
stored in the HD unit 106. However, the CAD result is 
read out from the HD unit 106 into the semiconductor 
memory 86 upon reception of a CAD output request as 
a trigger. In this case, the workstation 14 does not per- 
form any operation associated with the CAD but simply 
displays the CAD result. Whenever an image is dis- 
played on the image display device (workstation), the 
CAD result for the displayed image is stored in the sem- 
iconductor memory 86. Therefore, a time from genera- 
tion of an output request to display the CAD result is 



shortened. 

[0107] In a tenth embodiment, a timing at which, an 
arithmetic operation of a CAD is started is when all the 
image data of one patient is transferred to the data base 

5 1 2. At this time, the CPU 88 reads out examination data 
and relevant data sequentially from the HD unit 1 06 into 
the semiconductor memory 86. In order to refer to the 
table (Fig. 1 5) of CAD algorithms and corresponding at- 
tribute data, the modality and the examination object are 

10 read out from the examination data (Fig. 2) and the im- 
aging direction and the CAD result ID address are read 
out from the relevant data (Fig. 6). These readout items 
of data are stored in the semiconductor memory 86. 
These items of data are compared with the attribute data 

15 of the image stored in the table (Fig. 1 5) of the ROM 92. 
If these items are coincide with those of a given CAD 
algorithm, this image is determined to be an image to 
which the given CAD algorithm can be applied, and the 
operation of the CAD is started. 

20 [0108] Upon the start of the CAD operation, image da- 
ta determined to be an object of the CAD is read out into 
the semiconductor memory 86. The CPU 88 executes 
a CAD operation program written in the ROM 92 and 
stores the result in the semiconductor memory 86. The 

25 CPU 88 transfers, as data flowing through the network 
16, the image data, the relevant data, the CAD result, 
and the examination data (for each examination) to the 
data base 12 via the LAN l/F 94. As shown in Fig. 34, 
the data base 12 handles the CAD result data as a part 

30 of the relevant data. 

[0109] When data is transferred to the workstation 14 
during image reading, the transferred data is temporarily 
stored in the HD unit 106. However, the CAD result is 
read out from the HD unit 106 into the semiconductor 

35 memory 86 upon reception of a CAD output request as 
a trigger. In this case, the workstation 14 does not per- 
form any operation associated with the CAD but simply 
displays the CAD result. Whenever an image is dis- 
played on the image display device (workstation), the 

40 CAD result for the displayed image is stored in the sem- 
iconductor memory 86. Therefore, a lime from genera- 
tion of an output request to display the CAD result is 
shortened. 

[0110] Fig. 39 is a block diagram showing the arrange- 
45 rnent of an eleventh embodiment. In the eleventh em- 
bodiment, a CAD processor 14a as shown in Fig. 36 is 
connected to the arrangement of the PACS shown in 
Fig. 1. When a request of starting a CAD operation is 
generated in the workstation 1 4, the CAD processor 1 4a 
50 is used to perform only the CAD operation at a high 
speed. Therefore, the workstation 14 transfers data re- 
quired for the CAD operation to the CAD processor 1 4a, 
and only the result is returned to the workstation 14. 
[0111] A timing at which the CAD operation is started 
55 is similar to that in the tenth embodiment. However, un- 
like in the tenth embodiment, the CAD operation is per- 
formed by the CAD processor 1 4a. The workstation 1 4 
supplies the image data, the examination data, and the 
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relevant data to the CAD processor 1 4a via the network 
16. As shown in Fig. 36, the CAD processor 14a has its 
own CPU. and by means of the CPU it executes the CAD 
operation and outputs the CAD result. The result of the 
CAD operation is transferred as result data having the 5 
fornnat shown in Fig. 22 to the workstation 14 via the 
network 16. As shown in Fig. 34, the workstation 14 or 
the data base 1 2 handles the CAD result as a part of the 
relevant data. 

[Oil 2] When data is transferred to the workstation 14 io 
during image reading, the transferred data is temporarily 
stored in the HD unit 106. The CAD result, however, is 
read out from the HD unit 106 into the semiconductor 
memory 86 upon reception of an output request for the 
CAD as a trigger. In this case, the workstation 14 does ^5 
not perform any operation associated with the CAD but 
simply displays the result. 

[0113] Processing executed by devices such as the 
modality, the workstation, and the data base takes a 
long processing time for they share a CPU. In this em- 
bodiment. however, since the processor having a CPU 
for a processing purpose only executes the processing, 
a processing time can be shortened. 
[01 14] As a twelfth embodiment, an embodiment con- 
cerned with a modification of a marker will be described 25 
below. Figs. 40 A to 40 E show modifications of a marker 
for pointing the ROI, and Figs. 41 A to 41 F show modi- 
fications of a marker for surrounding the ROI. Pointing 
the ROI includes a case in which the direction of an ar- 
row points the center of the ROI as shown in Fig. 42A 
and a case in which it points a position other than the 
center as shown in Fig. 42B. 

[0115] According to this embodiment, an alarming 
means which strongly attracts attention is used in order 
to alarm abnormality. Therefore, an oversight and there- 
fore an erroneous diagnosis can be prevented, and this 
results in an improvement in diagnosis precision. 
[0116] A thirteenth embodiment in which an on/off of 
the CAD result display is controlled for each of the CRTs 
will be described. The touch panel includes plural CAD 
result display buttons provided for the respective CRTs. 
In order to display only the CAD result on the CRT #1 , 
it is necessary to depress the CAD result display buttons 
for the CRT #1. When the depression of that button is 
detected, the ID of the image displayed on the CRT #1 
is read out from the CRT display control table (Fig. 14). 
The CAD result address is read out from the relevant 
data of the image and the CAD result data is written into 
the overlay memory for the CRT #1 , thereby displaying 
the CAD result overlapped on the image. As described 
above, the operation of this embodiment is the same as 
that of the first embodiment except that the image ID is 
read out from the CRT display control table. If no CAD 
result address is stored (nothing is stored in the CAD 
result ID), the same operation as the first embodiment 
is performed from application of a suitable CAD algo- 
rithm to the image data to writing the CAD result address 
into the table. 
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[0117] According to the thirteenth embodiment, only 
necessary CAD results are selectively displayed during 
the reading of the images displayed on the CRTs of the 
workstation, therefore, the display is not complicate due 
to the omission of display of unnecessary CAD result. 
[0118] A fourteenth embodiment which is a modifica- 
tion of the thirteenth embodiment will be descried. In this 
embodiment, when the image ID of the CRT display con- 
trol table is updated upon changing the image to be dis- 
played, the CAD result address is read out from the rel- 
evant data of the new image and the CAD result is writ- 
ten into the overlay memory, thereby displaying the CAD 
result overlapped on the image. That is. when the image 
ID is designated, the CAD result is automatically dis- 
played regardless of whether or not the image has been 
read. If no CAD result address is stored (nothing is 
stored in the CAD result ID), the same operation as the 
first embodiment is performed from application of a suit- 
able CAD algorithm to the image data to writing the CAD 
result address into the table. When the depression of 
the CAD display button for a reference image (an image 
other than the image which has been read), the IDs of 
the images displayed on the CRTs are read out from the 
CRT display control table (Fig. 14) and it is determined 
whether or not the image has been read. If the image 
has been read, the CAD result address is read out from 
the relevant data and the CAD result is written into the 
overlay memory, thereby displaying the CAD result 
overlapped on the image. For all the CRTs, this opera- 
tion is performed. It is to be noted that all the data in the 
overlay memory are deleted before the CAD result is 
written into the memory. 

[0119] According to the fourteenth embodiment, since 
the CAD result is automatically output upon changing 
the image to be displayed, labors for instructing the CAD 
result output. It is possible to make a comparison diag- 
nosis with reference to the reference image which has 
been read, thereby improving the diagnosis precision. 
[01 20] A fifteenth embodiment as a modification of the 
thirteenth embodiment will be described. The touch pan- 
el includes a single CAD result display button provided 
for all the CRTs. When the depression of the display but- 
ton is detected, the IDs of the images displayed on the 
CRTs are read out from the CRT display control table 
(Fig. 14). The CAD result addresses for all the images 
are read out from the relevant data and the CAD result 
data are written into the overlay memories for all the 
CRTs, thereby displaying the CAD results overlapped 
on the images. The CAD results are automatically dis- 
played regardless of whether or not the images have 
been read. If no CAD result address is stored (nothing 
is stored in the CAD result ID), the same operation as 
the first embodiment is performed from application of a 
suitable CAD algorithm to the image data to writing the 
CAD result address into the table. 
[0121] According to the fifteenth embodiment, since it 
is possible to make a comparison diagnosis with refer- 
ence to the reference image which has been read, there- 
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by improving the diagnosis precision. When the CAD re- 
sult display is desired, ft is sufficient to touch only one 
button so that the operation is simple. 
[0122] A sixteenth embodiment which is a further 
modification of the thirteenth embodiment will be de- 
scribed. The touch panel includes a CAD result display 
button for the image which has not been read and a CAD 
result display button tor the reference image (an image 
other than the image which has not been read). When 
the depression of the CAD result display button tor the 
image which has not been read is detected, the IDs of 
the images displayed on the CRTs are read out from the 
CRT display control table (Fig. 14). It is determined 
whether or not the image has not been read based on 
the relevant data of the image. If the image is detected 
as being not read, the CAD result address is read out 
from the relevant data of the image and the CAD result 
data is written into the overlay memory. All the data in 
the overlay memory are deleted before the CAD result 
is written into the memory. When the depression of the 
CAD result display button for the reference image is de- 
tected, the IDs of the images displayed on the CRTs are 
read out from the CRT display control table (Fig. 14). It 
is determined whether or not the image has not been 
read based on the relevant data of the image. If the im- 
age is detected as being not read, the CAD result ad- 
dress is read out from the relevant data of the image 
and the CAD result data is written into the overlay mem- 
ory. All the data in the overlay memory are deleted be- 
fore the CAD result is written Into the memory. If no CAD 
result address is stored (nothing is stored in the CAD 
result ID), the same operation as the first embodiment 
is performed from application of a suitable CAD algo- 
rithm to the image data to writing the CAD result address 
into the table. 

[0123] According to the sixteenth embodiment, since 
it is possible to make a comparison diagnosis with ref- 
erence to the reference image which has been read, 
thereby improving the diagnosis precision. When the 
CAD result display is desired, it is sufficient to touch only 
one button so that the operation is simple. 
[0124] A seventeenth embodiment wilt be described. 
Though the above description, a suitable CAD algorithm 
is selected by the computer using the attribute data, in 
this embodiment, the doctor designates the name of the 
CAD algorithm. Before reading of the image, the doctor 
selects one or more CAD algorithms as well as inputting 
the examination ID. The names of the selected algo- 
rithms are arranged in the form of the table as shown in 
Fig. 43. When the image is input to the workstation, the 
CAD algorithms in the table are sequentially applied to 
the images. The other operation is the same as the first 
embodiment. 

[0125] According to the seventeenth embodiment, 
only a desired CAD result is selectively displayed and 
the display becomes simple. 

[01 26] As has been described above, according to the 
present invention, there is provided a computer-aided 



diagnosis system for medical use, which outputs com- 
puter-aided diagnosis data with a high precision by a 
simple operation haying no adverse effect on diagnosis 
made by doctors and a picture archiving communication 
s system incorporating the computer-aided diagnosis 
system for medical use and having a high diagnosis pre- 
cision. 

10 Claims 

1 . A system for analyzing a medical image ( 1 4) using 
a computer-aided diagnosis algorithm, comprising: 

IS interface means (84, 94) tor loading a medical 

image as digital data; 

means (86) for storing said medical image data 
wherein said medical image data comprise at- 
tribute image data comprising information relat- 
20 ed to the type of medical image which can be 

analyzed by computer aided diagnosis 
algorithms ; 

algorithm storing means (92) for storing a plu- 
rality of said computer-aided diagnosis algo- 

25 rithms tor detecting different types of abnormal 

portions in the medical image; 
means (88) for analyzing the medical image da- 
ta using one of said plurality of computer-aided 
diagnosis algorithms to detect abnormal por- 

30 tions in said medical image ; and 

means for displaying an analysis result of said 
analyzing means, characterized in that said in- 
terface means (84. 94) further comprise means 
to input said attribute image data of the medical 

35 image as digital data; 

said analyzing means comprises: 
means (92) for storing for each of said plurality 
of computer aided diagnosis algorithms at- 
tribute data defining the type of medical image 

40 which can be analyzed by the computer-aided 

diagnosis algorithm; 

means (88) for selecting, based on said at- 
tribute data stored in said storing means and 
said attribute image data of the medical image 
45 to be analyzed, an optimum computer aided di- 

agnosis algorithm suitable to analyse said med- 
ical image and 

wherein said analyzing means analyzes said 
medical image data using said optimum com- 
50 puter-aided diagnosis algorithm selected by 

said selecting means. 

2. A system according to claim 1 , characterized by fur- 
ther comprising: 

55 

a network (16) connected to said interface 
means 

data base means (12) connected to said net- 
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work for storing the medical image data, an 
analysis result data of said analyzing means, 
and association data indicating the relationship 
between the medical image data and the ana- 
lyzing result data; and ^ 
means for writing said analysis result data and 
said association data into said data base 
means via said network by means of said inter- 
face means. 

10 

A system according to claim 1 or 2, characterized 
in that a plurality of modalities are connected to said 
network. 

A system according toclalm 2, characterized by fur- 
ther comprising: 

means (80) for inputting retrieval data to re- 
trieve desired analysis result data stored in said 
data base means (12); and 
means for reading out the analysis result data 
from said data base means (12) in accordance 
with said retrieval data. 

A system according to claim 1 or 2 wherein said at- 25 
tribute image data further comprise information de- 
noting whether or not a medical image has been 
viewed by a doctor, characterized by further com- 
prising: 

means for selectively extracting one of a first 30 
plurality of medical images which have been viewed 
by a doctor and one of second plurality of medical 
images which have not been viewed by a doctor 
based on said attribute image data, and character- 
ized in that said analyzing means analyzes said 35 
medical images extracted by said extracting means 
using said optimum selected computer-aided diag- 
nosis algorithm. 

A system according to claim 2. characterized in that 40 
said attribute image data further comprise informa- 
tion denoting whethe r or not the medical image has 
been analyzed by said analyzing means. 

A system according to claim 6, characterized in that 
said analyzing means analyzes a medical image 
which has been viewed by a doctor but has not been 
analyzed by said analyzing means. 

A system according to anyone of claims 5 to 7, char- 50 
acterized by further comprising display means (82, 
100, 102) for displaying the medical image which 
has not been viewed by a doctor without the analy- 
sis result of said analyzing means and displaying 
the medical image which has been viewed by a doc- 55 
tor with the analysis result. 



Patentanspruche 

System zum Analysieren eines medizinischen Bilds 
(14) unter Verwendung eines computerunterstutz- 
ten Diagnosealgorithmus, mit 

einer Schnittstelleneinrichtung (84, 94) zum La- 
den eines medizinischen Bilds in Form von di- 
gital en Daten; 

einer Einrichtung (86) zum Speichern der me- 
dizinischen Bilddaten. wobet die medizinischen 
Bilddaten Attributbilddaten enthalten. die mit 
dem Typ des medizinischen. mittels der com- 
puterunterstutzten Diagnosealgorithmen ana- 
lysierbaren Bilds zusammenhangende Infor- 
mationen aufweisen; 

einer Algorithmusspeichereinrichtung (92) zum 
Speichern einer Mehrzahl der computerunter- 
stutzten Diagnosealgorithmen zum Erfassen 
von unterschiedlichen Arten von abnormalen 
Abschnitten in dem medizinischen Bild; 
einer Einrichtung (88) zum Analysieren der me- 
dizinischen Bilddaten unter Verwendung eines 
aus der Mehrzahl von compute runterstutzten 
Diagnosealgorithmen, um hierdurch einen ab- 
normalen Abschnitt in dem medizinischen Bild 
zu erfassen; und 

einer Einrichtung zum Anzeigen eines von der 
Analysiereinrichtung gewonnenen Analyseer- 
gebnisses, dadurch gekennzeichnet, daB die 
Schnittstelleneinrichtung (84, 94) weiterhin ei- 
ne Eingabeeinrichtung zum Eingeben der Attri- 
butbilddaten des medizinischen Bilds in Form 
von digitalen Daten umfa3t, und 
daf3 die Analysiereinrichtung eine Einrichtung 
(92) zum Speichern von Attributdaten, die den 
Typ des medizinischen Bilds definieren, das 
durch den computerunterstutzten Diagnoseal- 
gorithmus analysiert werden kann, und zwar tur 
jeden aus der Mehrzahl von computerunter- 
stutzten Diagnosealgorithmen; und eine Ein- 
richtung (88) zum Auswahlen eines optimalen 
computerunterstutzten Diagnosealgorithmus, 
der zum Analysieren des medizinischen Bilds 
geeignet ist, auf der Basis der in der Speicher- 
einrichtung gespeicherten Attributdaten und 
der Attributbilddaten des medizinischen, zu 
analysierenden Bilds; wpbei die Analysierein- 
richtung die medizinischen Bilddaten unter Ver- 
wendung des optimalen computerunterstutz- 
ten Diagnosealgorithmus analysiert, der durch 
die Wahleinrichtung ausgewahit worden ist. 

2. System nach Anspruch 1 , dadurch gekennzeichnet, 
daf3 es weiterhin aufweist: ein Netzwerk (16) das 
mit der Schnittstelle verbunden ist; 

eine Datenbankeinrichtung (12). die mit dem 
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Nelzwerk verbunden ist und zum Speichern der 
medizinischen Bilddaten, von von der Analy- 
siereinrichtung gebildeten Anatyseergebnisda- 
ten, und von Assoziationsdaten dient. die die 
Beziehung zwischen den medizinischen Bild- 5 
daten und den Analyseergebnisdaten ange- 
ben; und 

eine Einrichtung zum Einschreiben der Analy- 
seergebnisdaten und der Assoziationsdaten in 
die Datenbankeinrichtung Ober das Netzwerk 
nnit Hilfe der Schnittstelleneinrichtung. 

System nach Anspruch 1 oder 2, dadurch gekenn- 
zeichnet, daB eine Melirzahl von Modalitaten mit 
dem Netzwerk verbunden sind. '5 

System nach Anspruch 2, dadurch gekennzeichnet, 
daB es weiterhin eine Einrichtung (80) zum Einge- 
ben von Wiedergewinnungsdaten fur die Wiederge- 
winnung von gewunschten Analyseergebnisdaten. 20 
die in der Datenbankeinrichtung (12) gespeichert 
sind; und eine Einrichtung zum Auslesen der Ana- 
lyseergebnisdaten aus der Datenbankeinrichtung 
(12) in Abhangigkeit von den Wiedergewinnungs- 
daten enthalt. ^5 

System nach Anspruch 1 oder 2, bei dem die Attri- 
butbilddaten weiterhin Informationen umfassen, die 
angeben. ob ein medizinisches Biid durch einen 
Arzt betrachtet worden ist oder nicht, dadurch ge- 30 
kennzeichnet. daB es weiterhin eine Einrichtung 
zum selektiven Herausgreifen eines aus einer er- 
sten Mehrzahl von medizinischen Bildern. die von 
einem Arzt betrachtet worden sind, und/oder eines 
aus einer zweiten Mehrzahl von medizinischen Bil- 35 
dern aufweist, die nicht durch einen Arzt betrachtet 
worden sind, wobei das Herausgreifen aus der Ba- 
sis der Attributbilddaten erfolgt. sowie dadurch ge- 
kennzeichnet, daB die Analysiereinrichtung die me- 
dizinischen Bilder, die durch die Einrichtung zum 
Herausgreifen herausgegriffen worden sind, unter 
Verwendungdes optimalen, ausgewahlten, compu- 
terunterstutzten Diagnosealgorithmus analysiert. 

System nach Anspruch 2, dadurch gekennzeichnet, 
daB die Attributdaten weiterhin Informationen um- 
fassen, die angeben, ob das medizinische Bild 
durch die Analysiereinrichtung analysiert worden ist 
Oder nicht. 

so 

System nach Anspruch 6, dadurch gekennzeichnet, 
daB die Analysiereinrichtung etn medizinisches Bild 
analysiert, das durch einen Arzt betrachtet worden 
ist, jedoch noch nicht durch die Analysiereinrich- 
tung analysiert worden ist. 55 

System nach einem der Anspruche 5 bis 7, dadurch 
gekennzeichnet, daB es weiterhin eine Anzeigeein- 



richtung (82, 100. 102) zum Anzeigen des medizi- 
nischen Bilds, das noch nicht durch einen Arzt be- 
trachtet worden ist, ohne das Analyseergebnis der 
Analysiereinrichtung, und zum Anzeigen eines me- 
dizinischen Bilds, das von einem Arzt betrachtet 
worden ist. zusammen mit dem Analyseergebnis 
aufweist. 



Revendications 

1 . Systeme pour analyser une image m^dicale (1 4) en 
utilisant un algorithme de diagnostic assists par or- 
dinateur. comprenant : 

des moyens formant interface (84. 94) pour 
fournir une image medicale sous forme de don- 
nees numeriques ; 

des moyens de stockage (86) pour stocker les- 
dites donn^es d'image medicate, lesdites don- 
n6es d'image m§dicale comprenant des don- 
nees d'attribut d'image comprenant des infor- 
mations concernant le type des images medi- 
cates qui peuvent etre analysees par des algo- 
rithmes de diagnostic assistes par ordinateur ; 

des moyens de stockage d'algorithmes (92) 
pour stocker une pluralite desdits algorithmes 
de diagnostic assistes par ordinateur et desti- 
nes a detecter des types differents de parties 
anormales dans I'image medicale ; 

des moyens d'analyse (88) pour analyser les 
donnees d'image medicale en utilisant I'un des- 
dits algorithmes de diagnostic parmi la pluralite 
d'algorithmes de diagnostic assistes par ordi-. 
nateur afin de detecter des parties anormales 
dans ladite image medicale ; et 

des moyens pour afficher un resultat d'analyse 
desdits moyens d'analyse, 

caract6rise en ce que 

lesdits moyens formant interface (84, 94) com- 
prennent en outre des moyens pour entrer les- 
dites donnees d'attribut d'image de I'image me- 
dicale sous forme de donnees numeriques ; 

lesdits moyens d'analyse comprennent : 

des moyens (92) pour stocker, pour chacun 
desdits algorithmes de diagnostic parmi ladite 
pluralite d'algorithmes de diagnostic assistes 
par ordinateur, des donnees d'attribut definis- 
sant le type d'images medicates qui peuvent 
etre analysees par Talgorithme de diagnostic 
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assists par ordinateur ; 

des moyens de selection (88) pour choisir, en 
se basant sur lesdites donn^es d'attribut stoc- 
kees dans lesdits moyens de stockage et sur s 
lesdites donnees d'attribut d'image de I'image 
m§dicale k analyser, ralgorithme de diagnostic 
assiste par ordinateur optimum qui convient 
pour I'analyse de ladite image m§dicale, et 
dans lequel 

lesdits moyens d'analyse analysent lesdites don- 
nees d'image medicale en utilisant ledit algorithme 
de diagnostic assists par ordinateur optimum choisi 
par lesdits moyens de selection. '5 

Systeme selon I'une de la revendicatlon 1, caracte- 
ris6 en ce qu'il comprend en outre : 

un reseau (16) connecte auxdits moyens for- 20 
mant interface ; 

une base de donnees (12) connectee audit re- 
seau et destinee a stocker les donnees d'ima- 
ges medicales. ainsi que des donn6es de re- 25 
sultats d'analyses desdits moyens d'analyse et 
des donnees d'association indiquant la relation 
entre les donnees d'images medicates et les 
donnees de resultats d'analyses ; et 

30 

des moyens d'ecriture, pour ecrire lesdites don- 
nees de resultats d'analyses et lesdites don- 
nees d'association dans ladite base de don- 
nees via ledit reseau a I'aide desdits moyens 
formant interface. 



en outre : 

des moyens pour extraire s6Iectivement une Image 
medicale d'une premiere plurality d'images m^dica- 
les qui oht 6X6 revues par un m^decin, et une image 
medicale parmi une deuxidme plurality d'images 
m6dicales qui n'ont pas 6t6 revues par un m^decin, 
en se basant sur lesdites donnees d'attributs d'ima- 
ges, et caracterise en ce que lesdits moyens d'ana- 
lyse analysent lesdites images m^dicales extraites 
par lesdits moyens d'extraction en utilisant ledit al- 
gorithme de diagnostic optimum choisi parmi ladite 
pluralite d'algorithmes de diagnostic assist6s par 
ordinateur. 

6. Systeme selon la revendicatlon 2, caracteris6 en ce 
que lesdites donnees d'attributs d'images compren- 
nent en outre des informations indiquant si I'image 
medicale a ^t^ analysee ou non par lesdits moyens 
d'analyse. 

7. Systeme selon la revendicatlon 6, caract6ris6 en ce 
que lesdits moyens d'analyse analysent une image 
medicale qui a 6X6 revue par un medecin mais qui 
n'a pas ete analysee par lesdits moyens d'analyse. 

8. Systeme selon I'une quelconque des revendica- 
tions 5^7. caract^risee en ce qu'il comprend en 
outre des moyens d'affichage (82, 100, 102) pour 
afficher I'image medicale qui n'a pas 6X6 revue par 
un medecin, sans les resultats d'analyses desdits 
moyens d'analyse, et pour afficher I'image medicale 
qui a ete revue par un medecin, avec les resultats 
d'analyses. 



Systeme selon I'une ou Tautre des revendications 
1 et 2. caracterise en ce qu'une pluralite de moda- 
Iit6s sont connectees audit reseau. 

40 

Systeme selon la revendicatlon 2, caracterise en ce 
qu'il comprend en outre: 

des moyens d'entree (80) pour entrer des don- 
nees de recherche afin de rechercher des don- 
n6es de resultats d'analyses desir^es stockees 
dans ladite base de donnees (12) ; et 

des moyens de lecture pour lire les donnees de 
resultats d'analyses depuis ladite base de don- 50 
nees (1 2) en accord avec lesdites donnees de 
recherche. 



Systeme selon I'une ou I'autre des revendications 
1 et 2, dans lequel lesdites donnees d'attributs 55 
d'images comprennent en outre des informations 
indiquant si une image medicale a e\6 ou non revue 
par un m6decin, caracterise en ce qu'il comprend 
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